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The purpose of this paper is uncertainty evaluation in a target differentiation problem. In 
the problem ultrasonic data fusion is applied using Dezert-Smarandache theory (DSmT). 
Besides of presenting a scheme to target differentiation using ultrasonic sensors, the paper 
evaluates DSmT-based fused results in uncertainty point of view. The study obtains pattern 
of data for targets by a set of two ultrasonic sensors and applies a neural network as target 
classifier to these data to categorize the data of each sensor. Then the results are fused by 





SA K EE E DSmT to make final decision. The Generalized Aggregated Uncertainty measure named 
eae ai r GAU2, as an extension to the Aggregated Uncertainty (AU), is applied to evaluate 


DSmT DSmT-based fused results. GAU2, rather than AU, is applicable to measure uncertainty in 
DSmT frameworks and can deal with continuous problems. Therefore GAU2 is an efficient 
measure to help decision maker to evaluate more accurate results and smoother decisions 


Target differentiation 
Ultrasonic 


are made in final decisions by DSmT in comparison to DST. 


© 2014 Elsevier Ltd. All rights reserved. 





1. Introduction 


Ultrasonic sensors are widely used in robotics applica- 
tions such as localization, target differentiations and map- 
ping. A measurement scheme is proposed which uses two 
sets of ultrasonic sensors to determine location and type of 
target surface (see Ref. |1]). In this study, concentration is 
on target differentiation based on pattern of data which 
are obtained by a set of two ultrasonic sensors. The target 
classification is performed by employing time of flight 
(TOF) of the sensors. Classification of different targets by 
using neural networks is achieved for outcomes of each 
sensor. Afterwards the results are fused together to make 
final decision. 
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There has been much research on sensor fusion meth- 
ods in recent years. The evidence theory, also known as 
Dempster-Shafer theory, is one of the most popular frame- 
works to deal with uncertain information. This theory is 
often presented as a generalization of probability theory, 
where the additivity axiom is excluded. The Dezert-Sma- 
randache Theory (DSmT) is a theory of plausible and para- 
doxical reasoning proposed by Dezert and Smarandache 
(see Refs. [2-5]). It can be considered as an extension of 
the classical Dempster-Shafer theory (DST) [6] but with 
fundamental differences. DSmT is able to solve complex 
static or dynamic fusion problems beyond the limits of 
the DST framework, especially when conflicts between 
sources become large and when the refinement of the 
frame of the problem under consideration becomes 
inaccessible because of the vague, relative and imprecise 
nature of elements |3]. There are some successful applica- 
tions of DSmT in target type tracking |7] and robot map 
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building [8-10]. Efficiency of DSmT in comparison to DST is 
confirmed in sonar grid map building [9]. 

On the other hand, uncertain information often exists on 
all levels of fusion process which are usually related to phys- 
ical constraints, detection algorithms, and the transmitting 
channel of the sensors | 11 |. Therefore, it is important to have 
an uncertainty evaluation after sensor fusion for better deci- 
sion making. Hartley [12] and Shannon [13] respectively 
established the field of information theory. Hartley measure 
and Shannon entropy have been used in the possibilities and 
probabilities frameworks, respectively. Based on these 
approaches, information or preferably uncertainty-based 
information can be quantified by different general measures 
commonly called measures of uncertainty | 14]. 

Several theories have been developed to deal with 
uncertainty such as probability theory, fuzzy sets theory, 
possibility theory, evidence theory and rough sets theory. 
Instead of opponents, they should rather be seen as 
complementary, each of them being designed for dealing 
with different types of uncertainty. Three main types of 
uncertainty have been identified [15]: fuzziness, conflict, 
and non-specificity, the latter two being unified under 
the term ambiguity. Different measures of ambiguity, often 
called measures of total uncertainty have been proposed. 
Among them, a measure of aggregated uncertainty named 
AU is proposed [16,17]. This measure is defined in the 
framework of evidential theory that aggregates the 
non-specificity and conflict. It has been proved that this 
measure satisfies the five Klir and Wierman’s requirements 
[14,18]. It have been formalized, within a broad range of 
theories of imprecise probabilities, the notion of a total 
aggregated measure of uncertainty and various disaggre- 
gations into measures of non-specificity and conflict | 19]. 
As another uncertainty measure, a new measure of aggre- 
gated uncertainty is introduced, named AM for Ambiguity 
Measure that aims at eliminating the shortcomings of AU 
such as computing complexity [20]. By AM, an alternative 
to measure ambiguity in Dempster-Shafer theory is 
offered. But actually, their proposed measure is not, in a 
general sense, sub-additive. It is showed this by a specific 
counterexample which clearly demonstrates that their 
assumption in the last step of the proof is incorrect and 
that AM indeed violates sub-additivity [21]. 

In spite of efficiency of AU measure, this uncertainty 
measure and its associated algorithm for computing |18], 
has devoted for DST framework and cannot be applied to 
DSmT directly. As mentioned before, DSmT is a generaliza- 
tion of DST. Two generalized AU measures, which are 
named GAU1 and GAU2, have been introduced by the 
authors (see Ref. [22]). It is proved that the new measures 
have enough efficiency to evaluate the DSmT based results. 
In this paper these new measures are used. An experimen- 
tal setup which is based on ultrasonic sensors is config- 
ured. Neural networks are used in the first level of the 
fusion process. Neural networks are trained by acquired 
data of the set of ultrasonic sensors and then outputs are 
used to perform the differentiation task. Finally, the 
obtained results of the DSmT-based decision maker are 
evaluated by the proposed uncertainty measures. 

This paper is organized as following: A short review on 
DSmT that are considered in uncertainty analysis is 


mentioned in Section 2. Section 3 is devoted to represent 
GAU2 as the new measure and a short discussion on the 
AU and GAU1 measures. In Section 4, experimental studies 
are carried out on uncertainty measurement for a target 
classification problem. Finally, some concluding remarks 
are presented in Section 5. 


2. Dezert-Smarandache Theory 


Dezert-Smarandache Theory is a theory of plausible 
and paradoxical reasoning [3-5]. The development of 
DSmT arises from the necessity to overcome the inherent 
limitations of Dempster-Shafer Theory (DST) [6] which 
are closely related with the acceptance of Shafer’s model 
for the fusion problem under consideration. This means 
the frame of discernment © = {04, 02,..., On} is implicitly 
defined as a finite set of exhaustive and exclusive hypoth- 
eses. The Dedekind’s lattice, also called in the DSmT frame- 
work hyper-power set D® is defined as the set of all 
composite propositions built from elements of © with U 
and N operators such that: 


(1) 0, 04, 05, eiii On E D®. 

(2) if A,B € D? then AUB € D?, ANB € D®. 

(3) No other elements belong to D®, except those 
obtained by using rule (1) or rule (2). 


DSmT starts with the notion of free DSm model, 
denoted M/(@), and considers © only as a frame of exhaus- 
tive elements {01, 62, ..., 0n} which can potentially overlap. 
When the free DSm model holds, the classic commutative 
and associative DSm rule of combination is performed. 
From a general frame ©, a map is defined as m(.): 
D® > [0, 1] associated to a given body of evidence as: 


m(?)=0, S > m(A)=1, O<m(A)<1 (2.1) 


AcD® 


The quantity m(A) is called the generalized basic belief 
assignment/mass (gbba) of A. The generalized belief and 
plausibility functions are defined in almost the same 
manner as within the DST, i.e. 


Bel(A)= X` m(B) (2.2) 
BeD®, BCA 

PI(A)= X` m(B) (2.3) 
BeD®, BnA#0 


When the free DSm model M/(@) holds for the fusion 
problem under consideration, the classic DSm rule of 
combination Mys = M(-) = [m $ m](.) of two indepen- 
dent sources of evidences over the same frame with belief 
functions Bel,(.), Belo(.) associated with gbba mj,(.), m2(.) 
corresponds to the conjunctive consensus of the sources. 
It is given by: 


VOED, mra =m0 = a (A)m(B) (2.4) 
‘ABC 

Since D® is closed under u and N set operators, this new 

rule of combination guarantees that m(.) is a proper gener- 

alized belief assignment, i.e. m(.): De® — [0, 1]. 
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3. Uncertainty measurement 


Measuring uncertainty or information means assigning 
a number or a value from some ordinal scale to a given 
model of an epistemic state. Two types of classical eviden- 
tial based uncertainties, non-specificity and conflict are 
often measured as part of the fusion techniques such as 
DST fusion (18). All of the uncertainty measures attempt 
to measure uncertainty in bits. One bit of uncertainty is 
the amount of total uncertainty regarding the truth or 
falsity of one proposition. One of the most appropriate 
uncertainty measures which are developed in DST frame- 
works is the Aggregate Uncertainty (AU) measure. While 
the goal of information fusion is to reduce the global 
uncertainties, (18) explored the concept of comprehensive 
uncertainty measurement in the DST framework. 


Definition 3.1. The measure of the Aggregated Uncer- 
tainty contained in Bel, denoted as AU(Bel), is defined by: 


AU (Bel) = max} -5p log, p} (3.1) 
OEO 

where the maximum is taken over all {Po }ọ-o such that for 

0€ ©, >> ve@Po = 1 and for all A C ©, Bel(A) < Y xeapx- 

It is proved that the measure satisfies all the proper- 
ties for a reasonable uncertainty measurement, specifi- 
cally the sub-additivity and additivity which are defined 
[14]. Algorithm of computing AU was originated [18]. 
The algorithm is applied for DST framework while it 
cannot be used for DSmT directly. The reason is hidden 
in the algorithm of computing AU and especially in the 
main difference of DST and DSmT. In the DST, the frame 
of discernment of the fusion problem under consideration 
assumed to have exhaustive and exclusive elementary 


prety 


or in a simple form: ©p = {0i hi-12 m {iN bija 2o n iN ON Oki j k=1.2.... 
iAj 


hypotheses but in DSmT these conditions are violated. 
The algorithm of computing AU measure states that at 
least one part of information which is determined by 
ANB will be missed if anyone wants to apply this algo- 
rithm to DSmT. Accordingly, uncertainty measurement 
would not be accurate. Two Generalized Aggregate 
Uncertainty measures, which are named GAU1 and 
GAU2, have been developed [22]. The idea of generalizing 
Aggregated Uncertainty measure in GAU1 to evaluate 
DSmT, is disjointing the free DSm model to separated sets 
(Fig. 1). In this manner, the main problem of fusion still 
have two events whereas there are three separated events 
such as a Shafer’s model with 3 events. Therefore, the 
Same algorithm of computing for AU measure can be used 
as the algorithm of computing the measure GAU1 after 
the mentioned extension in order to evaluate the 
DSmT-based fusion results. 


wy OP 


Fig. 1. Disjointing of framework of free DSm model with two jointed 
events to three excluded sets. 


Although GAU1 is applicable to evaluate uncertainty in 
DSmT framework, the extension that is used in GAU1 is true 
for the problems where the refinement is possible. There 
are some cases that the refinement is not possible, for 
example when the frontiers of the sets in the frame of dis- 
cernment are not clear. So this refinement may not work for 
any frame of discernment. The new uncertainty measure 
which has been called, Generalized Uncertainty measure 
2 or GAU2 has been introduced to overcome this limitation 
[22]. In GAU2, despite of GAU1, clarity of the frontiers of the 
sets in the frame of discernment is not necessary. Therefore 
GAU2 is a suitable uncertainty measure for continuous 
frameworks. Consider the set of non-exclusive events 
© = {64, 05, ..., On} or ©= {0|0 = 0;,1= 12,204 n}. GAU2 is 
defined based on a class of probability distribution of 
events of a set such as ©p whereas the entropy of Shannon 
is maximized. ©p is equal to: 


Op = { O|Op = 0p, j = oe, 


Qa 


iel 
041 C{1,2.....n} 


Op|Op = Op, = 


izjzk 


And cardinality of @p is: |@p|=nNne, = ey 


i=1 


Definition 3.2. The measure of the Generalized Aggre- 
gated Uncertainty 2 contained in Bel, GAU2(Bel), which is 
defined by: 


GAU2 (Bel) = max - X Pa, log, 3 (3.2) 


0pEOp 


Po, is the associated probability distribution assignment of 
each event of ©p and the maximum is taken over all 
{Por Joco, such that for all Opc@p, O<p,, <1, 
Soco (1) t Po =1, &(OP = Niati) = II where (AIC 
{1,2,...,n}), Bel(A) < X opcaPo forall OFA C Op. 
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| +15°  +30° 


Fig. 2. Experiment setup and 20 different positions of targets. 


The generalized algorithm for computing the GAU2 
measure is: 

Input: a frame of discernment © (with n non-exclusive 
events), a generalized belief function Bel on © 

Output: GAU2(Bel), {Dp, } such that: 


Op€Op 


GAU2(Bel) = — X` py, log, Dy, 


OpEOp 


@p = {6p|6p = 0p, j = 1,2,...,Ne,} = { 9p, OP, -==> Png, } 


Op)+1 
Pop = Pop, lop=0p, j=1.2 a nep’ ` (-1) n Pop =1,0< Po, <1 


OpEOp 


a(o = P) = |I| where (Ø#I c {1,2,...,n}) 


ic] 


Bel(A) < X pp, forall 04A C Op 


OpcA 


Line (1) begin 
Line (2) make 


Op = {Ol = O,, j=1,2,...,No, } 


[| 4 


iel 
OIC {1,2.....n} 


Line (3) Y= Op, Bel' = Bel 

Line (4) while Y  @ and Bel'(Y) > 0 do 

Line (5) find a non-empty set A C ©p such that Bel(A)/ 
|A| is maximal if there are more such sets A than one, take 
the one with maximal cardinality end if 

Line (6) for each 0p € A do p,, = Bel'(A)/|A| end for 

Line (7) for each BC (Y — A) u (Y NA) do 

Beľ (B) = Bel'(B UA) — Bel'(A) + Bel (B n A) end for 

Line (8) Y = (Y—A)U(YNA) 


= 4 bp|Op = Op, = 


Line (9) end while 

Line (10) if Beľ (Y) = 0 and Y#¢ then 
Line (11) for all 6p € Y dop,, = O end for 
Line (12) end if 

Line (13) GAU2(Bel) = —>°,,-0,Po, 1082 Po, 
Line (14) end 


(a) Plane 
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Fig. 3. Normalized data of ultrasonic sensors in 20 positions (4 ranges 
and 5 angles) for the targets “Plane”, “Cylinder” and “Corner”. 


Clearly, one may see the differences between the above 
algorithm and the algorithm of AU measure. The differ- 
ences are: 


e Replacing the set of non-exclusive events © by the new 
set Op. 
e The condition imposed to 0p in the Definition 3.2. 
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e Lines 7 and 8 of the GAU2 measure algorithm to con- 
tinue the computations of the next probability 
assignments. 


4. Experimental study: ultrasonic sensors for target 
classification 


4.1. Experiment setup 


In the experimental setup, two identical acoustic trans- 
mitter/receiver pairs with center-to-center separation 
d= 35cm are employed. The common targets that there 
exist in real environment of mobile robot applications such 
as Plane, Cylinder with diameter 20 cm and Corner with 90° 
angle are considered. TOF data are collected at 20 sensor 
locations which are located at 5 different angles from 
p=-—30° to m=+30° in 15° increments, and from 
r=0.5m to r=2m in 0.5m increments separately 
(Fig. 2). To disaffect the distances of targets in target 
classification, the data are normalized regarding distance. 
Consequently, the targets can be classified regardless to 
the mentioned positions. Fig. 3 indicates normalized data 
of ultrasonic sensors for these 20 positions for the targets. 

TOF signals of each sensor pair are used as input signals 
of a neural network. The hidden layer comprises 50 
neurons and hyperbolic tangent as nonlinear functions 
and linear functions at the output layer with 3 neurons. 
For each sensor, One set of data are collected for each 
target location for each target primitive, resulting in 60 
(=4 ranges x 5 angles x 3 target types) sets of data. The 
network is a multi-layer perceptron (MLP) network with 
a learning constant equal to 0.9, momentum constant 
equal to 0.5, and a sigmoid-type nonlinearity. The neural 
network estimates the target type using these data. 


4.2. Sensor fusion with uncertainty measurement 


In this section, DST and DSmT are applied to the results 
that are obtained by neural networks in order to differen- 
tiate the target types. After the results of two sensors are 
fused, uncertainty measurement has been carried out 
according to AU measure for DST and the GAU1 and 
GAU2 measures for DSmT. 

Table 1 gives the results of correct target type classifica- 
tion that are considered as basic belief assignment of each 
sensor of the three targets for the case that the target 
object is “Plane”. Accordingly, each sensor by using a 
trained neural network presents a quantity to differentiate 
the targets. In this table, “P” is used to represent “Plane”, 
“Cy” is for “Cylinder” and “Co” is for “Corner” and “®” is 
devoted to represent total ignorance i.e. © = P U Cy U Co. 


4.2.1. Results of DSmT-based fusion and uncertainty 
evaluation by GAU2 measure 

Table 2 illustrates the results of DSmT-based fusion 
results. When DSmT is used, the number of events to be 
decided is more than number of events in DST because of 
using hyper-power set and free DSm model. DSmT fusion 
showed its capabilities in continuous problems as well as 
problems with non-exclusive events. Basically, DST has 
not enough efficiency to deal with problems with such 


Table 1 
Outputs of neural network based classifier as basic belief assignment and 
DST based fusion results; target type: “Plane”. 


a Sensor1 Sensor2 Mps1(A) 
P 0.7333 0.5333 0.8698 
Cy 0 0.1333 0.0178 
Co 0 0.0667 0.0592 
PU Cy 0.1333 0.1333 0.0355 
PU Co 0.0667 0 0.0059 
Cy UCo 0.0667 0.0667 0.0118 
© 0 0.0667 0 


models. On the other hand, advantages of using DSmT 
fusion should be studied in uncertainty point of view as 
well. Therefore, DSmT-based fusion results of the target 
differentiation are evaluated by GAU2 measure. According 
to Definition 3.2, members of the set @p are defined as: 
Op E {04, Oo,..., 07} where: 6,=P, Q= Cy, 63=Co, 04= 
P A Cy, 05 = PA Co, Os = Cy N Co, 07 = PN Cy N Co. 

The first step of the algorithm of computing is illus- 
trated in Table 2. The maximum value of Bel(A)/|A| is 
obtained for the event P, therefore pp = 0.8755. According 
to the algorithm, by discarding the event P and 
consequently its union the results the GAU2 measure 
continues. It is concluded that pcy = 0.1957, pco = 0.1022, 
Ppncy = 0.0978, Ppenco = 0.0489, Poynco = 0.0267, Ppacynco = 0. 
Therefore uncertainty in the DSmT-based results by GAU2 
(Eq. (3.2)) is equal to 1.6453. 

To investigate the uncertainty improvement in the 
results of DSmT fusion, uncertainties in the results of each 
sensor have to be considered. Similarly uncertainty in each 
sensor can be computed by the measure GAU2. The value 
of uncertainties in Sensor1 and Sensor2 by the GAU2 are 
computed by the algorithm and are equal to 1.1034 and 
1.4036, respectively. Uncertainty evaluation of DSmT 
fusion by GAU2 shows that the DSmT reduces the amount 
of uncertainty in final decisions. Uncertainty in DSmT 
fusion results are less than the sum of uncertainties in 
Sensors 1&2. So it can be concluded that DSmT has 
improved the results in uncertainty point of view. 


Table 2 
The 1st step of the algorithm of computing GAU2 measure for the DSmT 
results; target type: “Plane”. 

















D® Mpsm(A) BeA)  BeKA)/AI 
P 0.6444 0.8755 0.8755 
Cy 0.0267 0.1334 0.1334 
Co 0.0089 0.0667 0.0667 
P U Cy 0.0267 0.9734 0.4867 
P U Co 0.0044 0.9199 0.4600 
Cy U Co 0.0089 0.3156 0.1578 
PA Cy 0.0978 0.0978 0.0978 
P N Co 0.0489 0.0489 0.0489 
Cy N Co 0 0 0 

PA (Cy u Co) 0.0844 0.1467 0.0734 
Cy N (Pu Co) 0.0089 0.0978 0.0489 
Co N (PU Cy) 0.0089 0.0489 0.0245 
Pu (Cy N Co) 0.0089 0.9022 0.4511 
Cy u (PN Co) 0.0178 0.2934 0.1467 
Co U (PA Cy) 0.0044 0.2622 0.1311 
PA Cy N Co 0 0 0 

(P n Cy) U(PN Co) u (Cyn Co) 0 0 0 

© 0 1 0.3333 
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Table 3 
Uncertainty measurement for sensor 1&2, DST and DSmT fusion results. 

Results Sensor1 Sensor2 Sensor1 + Sensor2 DST DSmT 
Uncertainty measurement by AU 1.1035 1.2730 2.3765 0.6680 - 
Uncertainty measurement by GAU1 2.7259 2.8078 5.5337 - 2.4866 
Uncertainty measurement by GAU2 1.1034 1.4036 2.5070 - 1.6453 

Table 3 summarizes the results of uncertainty References 


measurement in the experiment. In the case of conflict 
measurements, DSmT must be used instead of DST. Also 
these experiments demonstrate that DSmT presents 
smoother decisions, especially in continuous models. Since 
AU is presented for DST and cannot be applied to the DSmT 
results, GAU1 and GAU2 are applicable as uncertainty 
measure for DSmT fusion results. Moreover this study 
shows the efficiency of DSmT to improve the final results 
in uncertainty point of view. Additionally, application of 
the GAU2 measure has not the limitation of the GAU1 
measure to deal with events with non-distinguishable 
borders. 


5. Conclusions 


In this paper, uncertainty evaluation problem in a deci- 
sion making system is considered. An experimental setup 
of ultrasonic sensors is established to study target differen- 
tiation problem and uncertainty measurement in decision 
making. A common neural network is used as classifier 
for each sensor path to get the classification results of 
the sensors. DSmT overcomes the limitations of DST. On 
the other hand, AU cannot be applied to DSmT because of 
the involved assumption in the algorithm of computing 
AU which states the events of frame of discernment must 
be without community. Generalized AU measures, i.e. 
GAU1 and GAU2 have been developed to overcome this 
limitation DSmT and the associated uncertainty measures 
are applied to the results of sensors and the results are dis- 
cussed in details. The final decision in the presented con- 
figuration has uncertainty less than each sensor’s 
measurement. On the other hand, efficiency of Generalized 
Uncertainty measures to measure uncertainty and more 
accurate results and smoother decisions are made in final 
decisions by DSmT in comparison to DST are validated. 
The following suggestions might be considered as further 
studies; 


e Employing other classification methods instead of neu- 
ral networks. 

e Utilizing ultrasonic echo signal amplitudes as acquired 
data in addition to TOF data. 

e Looking for an uncertainty measure with less complexity 
than AU, GAU1 and GAU2 in computation, which satis- 
fies the requirements of uncertainty measures 
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